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AMENDMENTS TO THE CLAIMS 

1. (Currently amended) A method of evaluating grammars associated with t he quality o f^veke 
input rooognition by a voice portal, said method comprising th e ot e po of ; 

extrooting a ourr e nt grommor from th e voio e portal; 

generating a test input for [[the]] a current gramma r of the voice portal> the test input 
including a test pattern and a set of aotiv e grommor s for the curr e nt grommor ; 
providing the test input to the voice portal; 

analyzing the test pattern with respect to [[the]] a set of active grammars r^nrragpnTiHing tn 
the current grammar w ith a speech recognition engine in the voice porta l, the current grammar being 
one grammar of the set of active grancmiars : and 

deriving a measure of how distinguishable the current grammar is from other grammars of 
the set of active grammars based at least in part on the analysis of the test patte m qualitv of 
r e cognition for th e current grammar ^ 

2. (Currently amended) The method of claim 1, >yherein [[said]] deriving a measure of how 
distinguishable the cvirrent grammar is from other grammars of the set of active grammars [[step] ] 
incliides th e s t e p of deriving a confidence level and a set of n-best results for the test input, and 
wherein the method f urther comprising th e st e ps of: comprises comparing the confidence level and 
set of n-best results for the test input with an expected value to assess the measure of quality o f 
r e oognition h ow distinguishable the current grammar is fit)m other grammars of the set of active 
grammars . 

3. (Currently amended) The method of claim 1, further comprising th e ot e po of: modifying the 
current grammar to create a modified grammar if the derived m easure of quality of rooognition for 
th e current grammar deviates from a pre-determined range. 

4. (Currently amended) The method of claim 3, ftirther comprising the st e ps of : 

(i) generating a test input for the modified grammar, the test input including a test pattern 
and a set of active grammars for the modified grammar; 
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(ii) providing the test input for the modified grammar to the voice portal; 

(iii) analyzing the test pattern for the modified grammar with respect to [[the]] a set of 
active grammars corresponding to the modified grammar with the speech recognition engine in the 
voice portal , the modified grammar being one fljammar of the set of a ctive grammars corresponding 
to the modified grammar : 

(iv) deriving a measure of quality of rooognition of how distinguishable t he modified 
gramma r is from other p ,rflmmars of the set of active grammars correspondmg to the modified 
grammar : and 

(v) re-modifying the modified grammar and repeating steps (i) through (iv) until the 
measure of giinlity of r e cognition of how distinguishable t he modified grammar is firom other 
grammars of the set of active grammars corresponding to the modified grammar d oes not deviate 
fxom a pre-determined range, 

5. (Currently amended) The method of claim 1 , further comprising the otepo of: modifying the 
test pattern to emulate one or more user voices prior to entering the test input into the voice portal. 

6. (Currently amended) The method of claim 1, fiirther comprising the stops of: modifying the 
test pattern to emulate the influence of one or more communications network qualities prior to 
entering the test input into the voice portal. 

7. (Currently amended) A comput e r program product for ovoluating the quality of voico input 
rooognition by a voio ^ portal, said comput e r program product oomprieing comput e r usable program 
oodo inoluding a routine s e t of computer-readable storage medium encoded with instructions which^ 
when executed by a maehfee computer, cause the ffiaehine computer t o perform the stops of a 
method of evaluatmg grammars associated with a vo ice portal, the method comprising: 

oictraoting a oxirr e nt grammar firom the voice portal; 

generating a test mput for [[the]] a current grammar of the voice portal, the test input 
including a test pattern ond a oot of ootivo grammars for tho ounont graiH Htaf; ! 

providing the test mput to the voice portal; , 

i 
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analyzing the test pattern with respect to [[the]] a set of active grammars corresponding to 
the current grammar w ith a speech recognition engine in the voice portal , the current grammar being 
one grammar of the set of active grammars : and 

deriving a measure o f how distinguishable the current grammar is fix)m other erannmars of 
the set of active granmiars based at least in part on the analvsis of the test patte rn quality of 
rooognition for the ourr e nt grammar . 

8. (Cxirrently amended) The oomputor program product computer-readable storage medium of 
claim 7, wherein [[said]] deriving a measure of how distinguishable the current grammar is from 
other grammars of the set of active grammars [fstcpll includes the step of deriving a confidence 
level and a set of n-best results for the test input, and wherein the method further causing said 
machin e to perform th e steps of: comprises c omparing the confidence level and set of n-best results 
for the test input with an expected value to assess the measure of quality of r e oognitionj iow 
distinguishable the current grammar is from other grammars of the set of active grammars. 

9. (Currently amended) The onmputor program product computer-readable stora g e medium o f 
claim 7, further causing said moohin e to perform tho Bt e p s-efe wherein the method further comprises 
modifying the current grammar to create a modified grammar if the derived measure of quality of 
rooognition for th e ourrent granmiar deviates from a pre-determined range. 

10. (Currently amended) The onmput o r program product computer-readable storage medium of 
claim 9, fiirthflu fimiraing mid maQhin e to porform tho Bt e po o fw herein the method further comprises : 

(i) generating a test input for the modified grammar, the test mput including a test pattern 
and a s e t of activ e grammars for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal; 

(iii) analyzing the test pattern for the modified grammar with respect to [[the]] a set of 
active grammars corresponding to the modified grammar with the speech recognition engine in the 
voice port al, the modified grammar being oy ie prt^TnTnar of the set of active grammars corresponding 
to the modified grammar: 



1667058.1 



Application No. 10/733,995 

R^ly to Office Action of November 1 3, 2008 

PageSof 14 



Docket No.: N0484.70571US00 



(iv) deriving a measure of quality of r e oognition of h ow distinguishable t he modified 
grammar is from other gr flmmara nf t he set of active grammars corresTwnding to the modified 
grammar : and 

(v) re-modifying the modified grammar and repeating steps (i) through (iv) until the 
measure of quality of rQoogniti(» ^ how distinguishable t he modified grammar is from other 
grammars of the set of active grammars corresponding to the modified grammar does not deviate 
from a pre-determined range. 

11. (Currently amended) The comput e r program product computer-readable storage medium of 
claim 7, forth e r cauGing Qoid machine to p e rform th & st e ps of: wherein the method further comprises 
modifying the test pattern to emulate one or more user voices prior to entering the test input into the 
voice portal. 

12. (Currently amended) The oomputcsr progrnm product computer-readable storage medium of 
claim 7, causing paid moohino to perform the Gtopc of: wherein the method further comprises 
modifying the test pattern to emulate the influence of one or more communications network 
qualities prior to entering the test input into the voice portal. 

1 3 . (Currently amended) A system for evaluating the quality of voice input rooognition by 
grammars of a voice portal having a speech recognition engine, comprising: 

m analyois int o rfac o for extracting a got of current grammars from the voice portal; 

a test pattern generator for generating a test input for each current grammar of a set of 
current grammars of the voice portal, the test input mcludii^ a test pattern and a oot of active 
grammars corresponding to e ach curr e nt granunor ; 

a text-to-speech engine for entering each test pattern into the voice portal; 

a results collector for analyzing each test pattern entered into the voice portal with the 
speech recognition engine against [[the]] g set of active grammars corresponding to the current 
grammar for-said -a respective t est pattern , the current gram mar heinp one grammar of the set of 
active grammars : and 
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a results analyzer for deriving a set of statistics indicative of how distinizuishable o f q quality 
of r e cognition of each current grammar of the set of current lamnmars is from other grammarsof 
the corresponding set of active grammars , 

14. (Currently amended) The system of claim 1 3, wherein the set of statistics includes a 
confidence level and a set of n-best results for each test input, and wherein the results analyzer is 
configured to compare the confidence level and set of n-best results for each test input with an 
expected value to assess th e quality of reoognition of how distinguishable e ach current granunar of 
the set of current grammars h aving said test input is.with respect to other grammars of its 
conesponding set of active granraiars. 

1 5. (Original) The system of claim 13, wherein the test pattern generator is configured to 
modify each test pattern to emulate one or more user voices prior to entering the test input into the 
voice portal. 

16. (Previously presented) The system of claim 13, wherein the test pattern generator is 
configured to modify each test pattern to emulate the influence of one or more communications 
network qualities prior to entering the test input into the voice portal, 

1 7. (New) The system of claim 13, further comprising an analysis interface for extracting the 
set of current grammars from the voice portal. 
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